Exactly once cache framework

ABSTRACT

A system for managing objects in a clustered network includes a file system containing at least one copy of a data object. The system can include several clustered servers in communication with the file system. A distributed consensus algorithm is used to select a host server. The selected host server can contain a copy of the data object, such as in local cache, providing access to the local copy to any other server in the cluster. Any change made to an item hosted by the host server can also be updated in the file system. If the host server becomes unable to host the object, a new host can be chosen using the distributed consensus algorithm. The other servers are then notified of the new host by multicast messaging.

CLAIM OF PRIORITY

This application is a continuation of U.S. patent application Ser. No.10/887,690, now U.S. Pat. No. 7,293,073, entitled “EXACTLY ONCE CACHEFRAMEWORK” by Jacobs, et al., filed Jul. 8, 2004, which is acontinuation of U.S. patent application Ser. No. 10/234,693, filed Sep.4, 2002, now U.S. Pat. No. 6,826,601, which claims benefit of U.S.Provisional Application No. 60/317,718, filed Sep. 6, 2001.

CROSS-REFERENCED CASES

The following U.S. Patent Applications are cross-referenced andincorporated herein by reference:

U.S. Patent Application No. 60/305,986 entitled “DATA REPLICATIONPROTOCOL,” by Dean Bernard Jacobs, Reto Kramer, and Ananthan BalaSrinivasan, filed Jul. 16, 2001.

U.S. Patent Application No. 60/317,566 entitled “EXACTLY ONCE JMSCOMMUNICATION” by Dean Bernard Jacobs and Eric Halpern, filed Sep. 6,2001.

TECHNICAL FIELD

The present invention is related to technology for distributing objectsamong servers in a network cluster.

BACKGROUND

In distributed computer systems, it is often the case that severalservers and/or networking nodes need to work together. These servers andnodes have to be coordinated, as there is typically networkinginformation that needs to be shared among the machines in order to allowthem to function as a single entity. Typical approaches to machinecoordination can be very expensive in terms of resources and efficiency.

In general, some synchronization is required for the nodes to agree, asthere may be several messages passing between the nodes. Thisrequirement for synchronization may, however, be undesirable in aclustered networking environment. Many clustered environments simplyavoid imposing any such synchronization requirement. There areapplications, however, where agreement is necessary.

In one case where agreement is needed, a device can exist to which acluster may want exclusive access. One such device is a transaction logon a file system. Whenever a transaction is in progress, there arecertain objects that need to be saved in a persistent way, such that ifa failure occurs those persistently-saved objects can be recovered.

For these objects that need to be saved in one place, there is typicallya transaction monitor that runs on each server in that cluster ordomain, which then uses a local file system to access the object. Eachserver can have its own transaction manager such that there is little tono problem with persistence. There is then also no need forcoordination, as each server has its own transaction manager.

For example, there can be a cluster including three servers, each serverhaving a transaction manager. One of those servers can experience afailure or other problem causing the server to be unavailable to thecluster. Because the failed server is the only server having access to aparticular transaction log, none of the transactions in that particularlog can be recovered until the server is again available to the cluster.

Recovery of the log can be difficult or at least inefficient, as aproblem with the server can take a significant amount of time to fix.Significant server problems can include such occurrences as the shortingout of a motherboard on the server or a power supply being burnt out.

BRIEF SUMMARY

The present invention includes a system for managing objects, such ascan be stored in servers on a network or in a cluster. The systemincludes a data source, application, or service, such as a file systemor Java Message Service component, which can be located inside oroutside of a cluster. The system can include several servers incommunication with the file system or application, such as through ahigh-speed network connection.

The system includes a lead server, such as can be agreed upon by theother servers. The lead server can be contained in a hardware cluster orin a software cluster. The system can include an algorithm for selectinga lead server from among the servers, such as an algorithm built into ahardware cluster machine. The lead server in turn will contain adistributed consensus algorithm for selecting a host server, such as aPaxos algorithm. The algorithm used for selecting the lead server can bedifferent from, or the same as, the algorithm used to select the hostserver.

The host server can contain a copy of the item or object, such as can bestored in local cache. The host server can provide local copy access toany server on the network or in a cluster. The host server can alsoprovide the only access point to an object stored in a file system, orthe only access point to an application or service. Any change made toan item cached, hosted, or owned by the host server can also be updatedin the file system, application, or service.

If the host server becomes unable to host the object, a new host can bechosen using a distributed consensus algorithm. The new host can thenpull the necessary data for the object from the file system or service.The other servers in the cluster can be notified that a new server ishosting the object. The servers can be notified by any appropriatemeans, such as by point-to-point connections or by multicasting.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram of a distributed object system in accordance withone embodiment of the present invention.

FIG. 2 is a diagram of another distributed object system in accordancewith one embodiment of the present invention.

FIG. 3 is a flowchart of a method for selecting a host server inaccordance with the present invention.

FIG. 4 is a flowchart of a method for selecting a new host server inaccordance with the present invention.

FIG. 5 is a flowchart of a method for utilizing a lead server inaccordance with the present invention.

FIG. 6 is a diagram of JMS message store system in accordance with oneembodiment of the present invention.

FIG. 7 is a block diagram depicting components of a computing systemthat can be used in accordance with the present invention.

DETAILED DESCRIPTION

Systems in accordance with the present invention can provide solutionsto availability issues, such as when a server owning a data objectbecomes unavailable to a server cluster. One such solution allows foranother server in the cluster to take over the ownership of the dataobject. A problem arises, however, in making the data object accessibleto both servers without having to replicate the data object on both.

If a file system, data store, or database (all collectively referred tohereinafter as “file system”) is used by the cluster to persistentlystore data, and the file system is accessible from more than one server,the second server can automatically take over the task of data objectaccess if the first server owning that object encounters a problem.Alternatively, there can be an algorithm utilized by the cluster or aserver in the cluster to instruct a server to take ownership of theitem. Another fundamental problem, however, involves getting the clusterto agree on which server now owns the resource or object, or achieving a“consensus” amongst the servers.

FIG. 1 shows one example of a cluster system 100 in accordance with thepresent invention, where an object such as a transaction log 114 isstored in a file system 112. The file system 112 is accessible to allservers 106, 116, 118 in the cluster 110, but only one of these serverscan access the log 114 at a time. A host server 106 among the servers inthe cluster 110 will “own” or “host” the log 114, such as by storing acopy 108 of the log 114 or by providing all access to the log 114 in thefile system 112. Any other server 116,118 in the cluster 110 can accessthe copy 108 of the log, and/or can access the log 114 through thehosting server 106. For example, a client or browser 102 can make arequest to a network 104 that is directed to server 116 in cluster 110.That server can access the copy 108 of the transaction log on the hostserver 106 through the network 104. If the transaction log needs to beupdated, the copy 108 can be updated along with the original log 114 onthe file system 112.

A server can “own” or “host” a data object when, for example, it acts asa repository for the object, such as by storing a copy of the dataobject in local cache and making that copy available to other servers inthe cluster, or by being the sole server having direct access to anobject in a file system, service, or application, such that all otherservers in the cluster must access that object through the hostingserver. This ensures that an object exists “exactly once” in the servercluster.

FIG. 3 shows one process 300 that can be used to establish the hostingof an object. A host server can be selected using a distributedconsensus algorithm 302, such as a Paxos algorithm. Such an algorithm isreferred to as a “distributed consensus” algorithm because servers in acluster must generally agree, or come to a consensus, as to how todistribute objects amongst the cluster servers.

If a hosted object is, for example, to be cached on the hosting server,a copy of the data object can be pulled from a file system to the hostserver and stored as an object in local cache 304. The other servers onthe network or in the appropriate cluster are then notified, such as bythe hosting server, that a local copy of the object exists on thehosting server, and that the local copy should be used in processingfuture network requests 306.

In a Paxos algorithm, one example of a distributed consensus algorithm,a server can be selected to act as a host or lead server by a networkserver, the network server leading a series of “consensus rounds.” Ineach of these consensus rounds, a new host or lead server is proposed.Rounds continue until one of the proposed servers is accepted by amajority or quorum of the servers. Any server can propose a host or leadserver by initiating a round, although a system can be configured suchthat a lead server always initiates a round for a host server selection.Rounds for different selections can be carried out at the same time.Therefore, a round selection can be identified by a round number or pairof values, such as a pair with one value referring to the round and onevalue referring to the server leading the round.

The steps for one such round are as follows, although other steps and/orapproaches may be appropriate for certain situations or applications.First, a round can be initiated by a leader sending a “collect” messageto other servers in the cluster. A collect message collects informationfrom servers in the cluster regarding previously conducted rounds inwhich those servers participated. If there have been previous consensusrounds for this particular selection process, the collect message alsoinforms the servers not to commit selections from previous rounds. Oncethe leader has gathered responses from at least half of the clusterservers, for example, the leader can decide the value to propose for thenext round and send this proposal to the cluster servers as a “begin”message. In order for the leader to choose a value to propose in thisapproach, it is necessary to receive the initial value information fromthe servers.

Once a server receives a begin message from the leader, it can respondby sending an “accept” message, stating that the server accepts theproposed host/lead server. If the leader receives accept messages from amajority or quorum of servers, the leader sets its output value to thevalue proposed in the round. If the leader does not receive majority orquorum acceptance (“consensus”) within a specified period of time, theleader can begin a new round. If the leader receives consensus, theleader can notify the cluster or network servers that the servers shouldcommit to the chosen server. This notification can be broadcast to thenetwork servers by any appropriate broadcasting technology, such asthrough point-to-point connections or multicasting.

The agreement condition of the consensus approach can be guaranteed byproposing selections that utilize information about previous rounds.This information can be required to come from at least a majority of thenetwork servers, so that for any two rounds there is at least one serverthat participated in both rounds.

The leader can choose a value for the new round by asking each serverfor the number of the latest round in which the server accepted a value,possibly also asking for the accepted value. Once the leader gets thisinformation from a majority or quorum of the servers, it can choose avalue for the new round that is equal to the value of the latest roundamong the responses. The leader can also choose an initial value if noneof the servers were involved in a previous round. If the leader receivesa response that the last accepted round is x, for example, and thecurrent round is y, the server can imply that no round between x and ywould be accepted, in order to maintain consistency.

A sample interaction between a round leader and a network serverinvolves the following messages:

-   -   (1) “Collect”—a message is sent to the servers that a new round        “r” is starting. The message can take the form of m=(“Collect”,        r).    -   (2) “Last”—a message is sent to the leader from a network server        providing the last round accepted, “a”, and the value of that        round, “v”. The message can take the form of m=(“Last”, r, a,        v).    -   (3) “Begin”—a message is sent to the servers announcing the        value for round r. The message can take the form of m=(“Begin”,        r, v).    -   (4) “Accept”—a message is sent to the leader from the servers        accepting the value for round r. The message can take the form        of m=(“Accept”, r).    -   (5) “Success”—a message is sent to the servers announcing the        selection of value v for round r. The message can take the form        of m=(“Success”, r, v).    -   (6) “Ack”—a message is sent to the leader from a server        acknowledging that the server received the decision for round r.        The message can take the form of m=(“Ack”, r).

There can be a file system that is separated from the servers, locatedeither inside or outside of a hardware or software cluster. This filesystem can persistently store the transaction log, such as by storingthe log on a first disk and replicating the log to a second disk withinthe file system. If the first disk crashes, the file system can hide thecrash from the cluster and/or server and get the log information fromthe second disk. The file system can also choose to replicate the log toa third disk, which can serve as a backup to the second disk.

From the perspective of a server in the cluster, the file system can bea single resource. In one embodiment, the server may only care that asingle server owns the file system at any time.

Another example of a system in accordance with the present inventioninvolves caching in a server cluster. It may be desirable in a clusteredenvironment, such as for reasons of network performance, to have asingle cache represent a data object to servers in the cluster. Keepingitems in a single cache can be advantageous, as servers in the clustercan access the cache without needing to continually return to persistentstorage. Being able to pull an item already in memory can greatlyincrease the efficiency of such a system, as hits to a database or filesystem can be relatively time intensive.

One problem with a single cache, however, is that it may be necessary toensure that the object stored in memory is the same as that which isstored on a disk of the file system. One reason for requiring suchconsistency is to ensure that any operations or calculations done on acached item produce the correct result. Another reason is that it can benecessary to restore the cache from the file system in the event thatthe cache crashes or becomes otherwise tainted or unavailable.

There can be at least two primary ways to handle this type of caching ina cluster, although other ways may work at least as well for certainapplications. One way is to replicate the cache in multiple places. Thisapproach can be problematic, as any change to an item being cachedrequires that all servers replicating the cache agree to, or are atleast aware of, the change. This can prove to be very expensive in termsof resources and performance.

An alternative approach in accordance with the present invention assignsa particular server to be the owner of a cache in the cluster, and allaccess to the cache goes through that particular server. Any server in acluster can host such a cache. Each server can host one, several, or nocaches. The caches can be hosted on a single server, or spread out amongsome or all of the servers in the cluster. The cluster itself can be anyappropriate cluster, such as a hardware cluster or a group of serversdesignated by a software application to be in a given “software”cluster.

It may be possible to think of either example, a transaction log and/ora cache, as a type of object that sits somewhere on a system. It may bedesirable to ensure that any such object exists only once in a cluster,and that the object is always available. It may also be desirable toensure that the object can be recovered on another server if the serverhosting the object fails, and that the object will be available to thecluster.

One method 400 for recovery is shown in FIG. 4. In this method, adetermination is made whether the host server can continue to host anobject 402, such as whether the server is still available to thenetwork. If not, a new host is selected using a distributed consensusalgorithm. This selection may be performed according to the method usedto select the original host 404. A copy of the data object is pulledfrom a file system to the new host, and can be stored in a local cache406. The other servers on the network or in the appropriate cluster arenotified that the new host server contains a local copy of the object,and that the local copy should be used in processing any future networkrequests 408.

Systems and methods in accordance with the present invention can defineobjects that exist in exactly one place in a cluster, and can ensurethat those objects always exist. From a server's perspective, it may notmatter whether an object such as a transaction log is mirrored orreplicated, such as by a file system. From the server's perspective,there is always one persistent storage accessible by any server in thecluster. The system can periodically check for the existence of anobject, or may assign ownership of objects for short periods of timesuch that an object will be reassigned frequently to ensure existence onsome machine on the network or in the cluster.

A hardware cluster can comprise a bank of machines, each machine beingcapable of running multiple servers. There can also be a file systembehind each machine. Servers in a hardware cluster are typicallyhardwired, such that they are able to more quickly make decisions anddeal with server faults within the hardware cluster. Hardware clusterscan be limited in size to the physical hardware of the machinecontaining the servers. Servers in a hardware cluster can be used asservers in a software cluster, and can also comprise network servers, asthe individual servers on the machines are available to the network.

The shared file system for one of these machines can be available to allservers in a cluster, such as through a high-speed network. The filesystem can also be redundant. In one embodiment, this redundancy isimplemented through the use of multiple data disks for the file system.In such a redundant implementation, an object can be replicated acrossmultiple disks any time the object is written to the file system. Such afile system, when viewed as a “black box,” can be able to withstandfailures of any of the disks and still provide access to a data itemfrom any of the servers in the cluster.

A framework in accordance with the present invention, referred to as an“exactly-once” framework, can be built on the assumption that theseobjects kept in memory are always backed by a reliable, persistentstorage mechanism. For example, there can be an object that represents atransaction log. Whenever a call is made to the object, thecorresponding transaction log can be updated. This may include a callthat either reads from, or writes to, a database. An object representingthat transaction log can be sitting on one of the servers in thecluster, such as the host server. An exactly-once framework can ensurethat, as long as at least one of the servers in the cluster is up andrunning, a server will be able to take over ownership of the log ifanother server fails.

There may be one object that represents a cache. Every time the cache isupdated, the update can also be written back to persistent storage. Whenone of the servers needs to use a data item, that server can be requiredto go through this object. If the server hosting the object thatrepresents the cache fails, the object can be resurrected on anotherserver. The resurrected object can pull all the necessary informationfrom persistent storage.

An exactly-once framework can act as a memory buffer for use by thecluster. The framework can provide a single cache representing data inthe system that is backed by a reliable, persistent storage. Wheneverdata is read from the cache, the read can be done without needing toaccess persistent storage. When an update is written to cache, however,it can be necessary to write back through the persistent storage, suchthat the system can recover if there is a failure.

One important aspect of an exactly-once framework involves the way inwhich the approach is abstracted, which can vary depending upon theapplication and/or implementation. A new type of distributed object iscreated, such as can be referred to as an “exactly-once object.” Anexactly-once object can be, for example, a locally-cached copy of a dataitem in a file system, or the sole access point to such a data item forservers in a cluster. Underlying techniques for implementing thisabstraction can also be important.

Systems of the present invention can utilize any of a number of methodsuseful for distributed consensus, such as a method using theafore-mentioned Paxos algorithm. Such an algorithm can be selected whichprovides an efficient way for multiple nodes and/or distributed nodes toagree on one value of an object. The algorithm can be chosen to workeven if nodes fail and/or return during an agreement process.

A typical approach to network clustering utilizes reliable broadcasting,where every message is guaranteed to be delivered to its intendedrecipient, or at least delivered to every intended functioning server.This approach can make it very difficult to parallelize a system, asreliable broadcasting requires a recipient to acknowledge a messagebefore moving on to the next message or recipient. A distributedalgorithm utilizing multicasting may reduce the number of guarantees, asmulticasting does not guarantee that all servers receive a message.Multicasting does simplify the approach such that the system can engagein parallel processing, however, as a single message can be multicast toall the cluster servers concurrently without waiting for a response fromeach server. A server that does not receive a multicast message can pullthe information from the lead server, or another cluster server ornetwork server, at a later time. As used herein, a network server canrefer to any server on the network, whether in a hardware cluster, in asoftware cluster, or outside of any cluster.

An important aspect of an exactly-once architecture is that consensusdifficulties are reduced. In accordance with the present invention, theperformance of a distributed consensus implementation can be improved byusing multicast messaging with a distributed consensus algorithm. Thisapproach can allow for minimizing the message exchange and/or networktraffic required for all the servers to agree.

When multicasting, one of several approaches can be taken. In a firstapproach, which may be referred to as “one-phase distribution,” a leadserver can multicast a message to all other servers on the network, suchas may be used in a round of a Paxos algorithm, or used to state that anew host has been selected for an object. In this approach, the leadserver only needs to send one message, which can be passed to any serveravailable on the network. If a server is temporarily off the network,the server can request the identification of the new host after comingback onto the network.

Using another multicast approach, which may be referred to as a“two-phase distribution,” the lead server can pre-select a host serverusing an appropriate algorithm. Before assigning an object to that host,however, the lead server can contact every other server in the clusterto determine whether the servers agree with the choice of the new hostserver. The lead server can contact each server by a point-to-pointconnection, or can send out a multicast request and then wait for eachserver to respond. If the servers do not agree on the selection of thehost, the lead server can pre-select a new host using the algorithm. Thelead server would then send out another multicast request with theidentity of the newly pre-selected host in another round.

If every server agrees to the pre-selected host, the lead server canassign the object to the host server. The lead server can then multicasta commit message, informing the servers that the new change has takeneffect and the servers should update their information accordingly.

An exactly-once framework can also utilize a “leasing” mechanism. Inusing such a mechanism, an algorithm can be used to get the clusterservers to agree on a lead server, such as by using distributedconsensus. Once selected, that lead server can be responsible forassigning exactly-once objects to various servers in the cluster. Thesystem can be set up such that the cluster servers will always agree ona new leader if an existing lead server fails.

While the lead server is active, the lead server can be aware of all theexactly-once objects that need to exist in the system. The lead servercan decide which server should host each object, and can then “lease”that object to the selected server. When an object is leased to aserver, that server can own or host the object for a certain period oftime, such as for the duration of a lease period. The lead server can beconfigured to periodically renew these leases. This approach can providea way to ensure that a server will not get its lease renewed if it failsor becomes disconnected in any way, or is otherwise not operatingproperly within the cluster.

Much of the problem with distributed systems under failure is that it isdiffucult to tell the difference between a server that has failed andone that is simply not responding. Any server that has been somehow cutoff the network can no longer host an object. That server will stillknow, even though it is not available to the cluster, that it can dropits hosting of any object after the lease period. As the server is notavailable to the cluster, it will not get its lease renewed.

The lead server also knows that, if the lead server is unable to reachthe host server within a certain amount of time, the host server willrelinquish its ownership of the object. The lease period can be for anyappropriate time, such as for a matter of seconds. The lease period canbe the same for all objects in the cluster, or can vary between objects.

A system using an exactly-once architecture can also be tightened down.Operating systems often provide special machinery that is built closerto the hardware and can offer more control. One problem with thisapproach, however, is that it can be limited by the hardware available.For example, a hardware cluster of servers can have on the order of 16servers. Because these systems require some tight hardware coupling,there can be limitations on the number of servers that can be includedin the cluster.

An exactly-once framework, on the other hand, may be able to handleclusters much larger than these proprietary hardware clusters canhandle. A framework can allow for some leveraging of the qualities ofservice that are available from one of the proprietary clusters, therebyallowing for a larger cluster. Differing qualities of service mayinclude, for example, whether messages are sent by a reliable protocol,such as by point-to-point connections, or are sent by a less reliablebut more resource-friendly protocol, such as multicasting. An advantageto using an exactly-once framework is the ability to balance scalabilitywith fault tolerance, such that a user can adapt the system to the needsof a particular application.

Prior art systems such as hardware cluster machines can attempt highavailability solutions by having (what appears to the cluster to be) asingle machine backed up by a second machine. If the first machine goesdown, there is a “buddy” that takes over, and any software that wasrunning on the first machine is brought up on the second machine.

An exactly-once framework in accordance with the present invention canassign the lead server to a server in one of these hardware clusters,such that dealing with leader failure can become faster than dealingwith it in a software cluster. This lead server can, however, dole outleases to servers whether those servers are in the hardware cluster orthe software cluster. This arrangement may provide for faster leadserver recovery, while allowing for a software cluster that is largerthan, but still includes, the hardware cluster.

One such system 200 is shown in FIG. 2. A hardware cluster 218 cancomprise a single machine containing multiple servers 220, 222, 224. Thehardware cluster can be used to choose a lead server 220 from among theservers on that machine, such as may improve efficiency. Once a leadserver 220 is selected, the lead server can select a host 206 for anobject 214 in a file system 212, which can be located inside or outsideof the software cluster 210. The file system 214 itself can replicatethe object 214 to a second object 216 on another disk of the filesystem, such as may provide persistence. The object 214 can be pulledfrom the file system 212 by the new host 206 with a copy 208 of theobject cached on the host 206. When a request is received from a browseror client 202 to a server through the network 204, such as servers 206,216, and 220, that server will know to contact host server 206 if theserver needs access to the cached copy of the object 208.

One method 500 for using such a system is shown in FIG. 5. The leadserver is selected using an algorithm of a hardware cluster 502. Thisalgorithm may be, for example, a proprietary algorithm of the hardwarecluster machine, or may be a distributed consensus algorithm requiringconsensus over the hardware cluster servers only. A host server can thenbe pre-selected using a distributed consensus algorithm with the leadserver 504, such as a Paxos algorithm. The identity of the pre-selectedhost can then be multicast to the other servers in a software clustercontaining the hardware cluster 506. The lead server can receiveapproval or disapproval from each server that is presently operationaland connected to the cluster 508. If the servers approve thepre-selected host server, a commit message is multicast to the clusterservers informing the servers that the pre-selected host now hosts theitem; otherwise, if the servers do not approve a new host ispre-selected and the process begins again 510.

An exactly-once framework can be used, for example, to handletransaction logs or caching. Such a framework can also be used, forexample, to define an administration server as an exactly-once objectand lease the administration server such that the administration servernever goes down.

FIG. 6 shows another example of a cluster system 600 in accordance withthe present invention, where an object 608 acts as a message store forJava Message Service (JMS) 612. All servers 606, 614, 616 in the cluster610 can use JMS, but they must send messages to the message store 608and pick up any messages from the message store 608 through the network604. A host server 606 of the servers in the cluster 610 will “own” or“host” the message store 608. A client or browser 602 can make a requestto a network 604 that is directed to server 616 in cluster 610. Thatserver 616 can access JMS only by sending a message to the message store608 on the host server 606 through the network 604.

FIG. 7 illustrates a block diagram 700 of a computer system which can beused for components of the present invention or to implement methods ofthe present invention. The computer system of FIG. 7 includes aprocessor unit 704 and main memory 702. Processor unit 704 may contain asingle microprocessor, or may contain a plurality of microprocessors forconfiguring the computer system as a multi-processor system. Main memory702 stores, in part, instructions and data for execution by processorunit 704. If the present invention is wholly or partially implemented insoftware, main memory 702 can store the executable code when inoperation. Main memory 702 may include banks of dynamic random accessmemory (DRAM), high speed cache memory, as well as other types of memoryknown in the art.

The system of FIG. 7 further includes a mass storage device 706,peripheral devices 708, user input devices 712, portable storage mediumdrives 714, a graphics subsystem 718, and an output display 716. Forpurposes of simplicity, the components shown in FIG. 7 are depicted asbeing connected via a single bus 720. However, as will be apparent tothose skilled in the art, the components may be connected through one ormore data transport means. For example, processor unit 704 and mainmemory 702 may be connected via a local microprocessor bus, and the massstorage device 706, peripheral devices 708, portable storage mediumdrives 714, and graphics subsystem 718 may be connected via one or moreinput/output (I/O) buses. Mass storage device 706, which may beimplemented with a magnetic disk drive, optical disk drive, as well asother drives known in the art, is a non-volatile storage device forstoring data and instructions for use by processor unit 704. In oneembodiment, mass storage device 706 stores software for implementing thepresent invention for purposes of loading to main memory 702.

Portable storage medium drive 714 operates in conjunction with aportable non-volatile storage medium, such as a floppy disk, to inputand output data and code to and from the computer system of FIG. 7. Inone embodiment, the system software for implementing the presentinvention is stored on such a portable medium, and is input to thecomputer system via the portable storage medium drive 714. Peripheraldevices 708 may include any type of computer support device, such as aninput/output (I/O) interface, to add additional functionality to thecomputer system. For example, peripheral devices 708 may include anetwork interface for connecting the computer system to a network, aswell as other networking hardware such as modems, routers, or otherhardware known in the art.

User input devices 712 provide a portion of a user interface. User inputdevices 712 may include an alpha-numeric keypad for inputtingalpha-numeric and other information, or a pointing device, such as amouse, a trackball, stylus, or cursor direction keys. In order todisplay textual and graphical information, the computer system of FIG. 7includes graphics subsystem 718 and output display 716. Output display716 may include a cathode ray tube (CRT) display, liquid crystal display(LCD) or other suitable display device. Graphics subsystem 718 receivestextual and graphical information, and processes the information foroutput to display 716. Additionally, the system of FIG. 7 includesoutput devices 710. Examples of suitable output devices includespeakers, printers, network interfaces, monitors, and other outputdevices known in the art.

The components contained in the computer system of FIG. 7 are thosetypically found in computer systems suitable for use with certainembodiments of the present invention, and are intended to represent abroad category of such computer components known in the art. Thus, thecomputer system of FIG. 7 can be a personal computer, workstation,server, minicomputer, mainframe computer, or any other computing device.Computer system 700 can also incorporate different bus configurations,networked platforms, multi-processor platforms, etc. Various operatingsystems can be used including Unix, Linux, Windows, Macintosh OS, PalmOS, and other suitable operating systems.

The foregoing description of preferred embodiments of the presentinvention has been provided for the purposes of illustration anddescription. It is not intended to be exhaustive or to limit theinvention to the precise forms disclosed. Obviously, many modificationsand variations will be apparent to the practitioner skilled in the art.The embodiments were chosen and described in order to best explain theprinciples of the invention and its practical application, therebyenabling others skilled in the art to understand the invention forvarious embodiments and with various modifications that are suited tothe particular use contemplated. It is intended that the scope of theinvention be defined by the following claims and their equivalents.

1. A system for managing objects on a network, comprising: a pluralityof network servers, each network server adapted to communicate with anetwork data source, wherein said plurality of network servers include adistributed consensus algorithm, the distributed consensus algorithmcomprising rounds of messages between a lead server and said pluralityof network servers, the rounds continuing until a majority of saidplurality of network servers agrees on a host server; and the hostserver assigned a copy of a data item, the data item located in thenetwork data source, wherein any of said plurality of network serversneeding to access the data item can access the copy on the host server.2. A system for managing objects on a network, comprising: a pluralityof network servers, each network server adapted to communicate with anetwork data source, wherein said plurality of network servers include adistributed consensus algorithm, the distributed consensus algorithmcomprising rounds of messages between a said network data source andsaid plurality of network servers, the rounds continuing until amajority of said plurality of network servers agrees on a host server;and the host server assigned the sole access point to a data itemlocated in the network data source such that any of said plurality ofnetwork servers needing to access the data item can access the data itemthrough the host server.
 3. A system for managing objects on a network,comprising: a file system containing at least one copy of a data item; aplurality of network servers in communication with the file system,wherein said plurality of network servers include a distributedconsensus algorithm, the distributed consensus algorithm comprisingrounds of messages between the file system and said plurality of networkservers, the rounds continuing until a majority of said plurality ofnetwork servers agree on a host server; and the host server in saidplurality of network servers, said host server assigned a local copy ofthe data item, said host server adapted to provide access to the localcopy to any of said plurality of network servers and update the copy ofthe data item in the file system any time an update is made to the localcopy.
 4. A system according to claim 3, wherein said host server isfurther adapted to store the local copy in a local cache.
 5. A systemaccording to claim 3, wherein said plurality of servers comprise acluster.
 6. A system according to claim 3, wherein said file systemreplicates the data item over multiple disks.
 7. A method for hostingJava Messenger Service (JMS) on a network, comprising: selecting a hostserver from among a plurality of network servers using a distributedconsensus algorithm, the distributed consensus algorithm comprisingrounds of messages between the host server and said plurality of networkservers, the rounds continuing until a majority of said plurality ofnetwork servers agrees on a host server; assigning a JMS object to thehost server, the JMS object comprising a JMS message store providing thesole access point and message queue for JMS over the network; andnotifying the network servers that the host server is hosting the soleJMS message store.
 8. A method according to claim 7, further comprisingthe step of: checking the JMS message store for messages intended forone of the plurality of network servers.
 9. A method according to claim7, further comprising the step of: sending a JMS message from a networkserver to the JMS message store on the host server.
 10. A methodaccording to claim 7, further comprising the step of: sending messagesin the JMS message store on the host server to a JMS component.
 11. Amethod for ensuring the availability of an administration server in acluster, comprising: selecting an administration server from among aplurality of servers using a distributed consensus algorithm, thedistributed consensus algorithm located on the plurality of servers andthe distributed consensus algorithm comprising rounds of messagesbetween the administration server and said plurality of network servers,the rounds continuing until a majority of said plurality of networkservers agrees on an administration server; pulling administrationinformation from a data source to the administration server and updatingadministration information in the data source in order to coordinateinformation in the data source and on the administration server; andnotifying other servers in the cluster of the identity of theadministration server.
 12. A method according to claim 11, wherein thestep of pulling administration information from a data source comprisespulling administration information from a file system.